Kappa — A Critical Review
نویسنده
چکیده
The Kappa coefficient is widely used in assessing categorical agreement between two raters or two methods. It can also be extended to more than two raters (methods). When using Kappa, the shortcomings of this coefficient should be not neglected. Bias and prevalence effects lead to paradoxes of Kappa. These problems can be avoided by using some other indexes together, but the solutions of the Kappa problems are not satisfactory. This paper gives a critical survey concerning the Kappa coefficient and gives a real life example. A useful alternative statistical approach, the Rank-invariant method is also introduced, and applied to analyze the disagreement between two raters.
منابع مشابه
Entanglement in quantum spin chains, symmetry classes of random matrices, and conformal field theory.
We compute the entropy of entanglement between the first N spins and the rest of the system in the ground states of a general class of quantum spin chains. We show that under certain conditions the entropy can be expressed in terms of averages over ensembles of random matrices. These averages can be evaluated, allowing us to prove that at critical points the entropy grows like kappalog(2N+kappa...
متن کاملDynamics of the two-dimensional gonihedric spin model.
In this paper, we study dynamical aspects of the two-dimensional (2D) gonihedric spin model using both numerical and analytical methods. This spin model has vanishing microscopic surface tension and it actually describes an ensemble of loops living on a 2D surface. The self-avoidance of loops is parametrized by a parameter kappa . The kappa=0 model can be mapped to one of the six-vertex models ...
متن کاملFinite-size scaling of energylike quantities in percolation.
We study the bond-percolation model in two and three dimensions by Monte Carlo simulation, and investigate the finite-size scaling behavior of several quantities that account for fluctuations of the total numbers of clusters and occupied bonds, Nc and Nb, respectively. These quantities include C(2c) = ( - 2)/Ld and C(cb) = ( - )/Ld, where L is the linear system size and...
متن کاملResistance distribution in the hopping percolation model.
We study the distribution function P (rho) of the effective resistance rho in two- and three-dimensional random resistor networks of linear size L in the hopping percolation model. In this model each bond has a conductivity taken from an exponential form sigma proportional to exp (-kappar) , where kappa is a measure of disorder and r is a random number, 0< or = r < or =1 . We find that in both ...
متن کاملDirect evidence for conformal invariance of avalanche frontiers in sandpile models.
Appreciation of stochastic Loewner evolution (SLE_{kappa}) , as a powerful tool to check for conformal invariant properties of geometrical features of critical systems has been rising. In this paper we use this method to check conformal invariance in sandpile models. Avalanche frontiers in Abelian sandpile model are numerically shown to be conformally invariant and can be described by SLE with ...
متن کامل